1 Student Growth Percentile Fit Plots

A goodness of fit plot is produced for each unique Spring 2016 Student Growth Percentile (SGP) analysis. All fit plots will contain at least four panels. Each panel is a different depiction of the distribution of the SGPs calculated in that analysis relative to the students’ prior or current achievement (i.e. the test scores used as the independent and dependent variables in the model).

The top panel is a mosaic plot that shows the percentage of students that fall into each prior proficiency level, and the location of the 10^th through 90^th quantiles of the SGP distribution represented as dashed white lines (with the exception of the solid white line for the median/50^th percentile). Ideally the median SGP will be at or near 50 for all prior achievement level groups. The top panel is excluded when students’ prior achievement level data is unavailable.

The “Ceiling/Floor Effects Test” panel helps identify problems in SGP estimation at the Highest and Lowest Obtainable/Observed Scale Scores (HOSS and LOSS). Appendix C provides a more detailed description of ceiling and floor effects and their causes. The table of values shows whether the current year scores at both extremes yield expected SGP values. The expectation is that the majority of SGPs for students scoring at or near the LOSS will be low (preferably less than 5 and not higher than 20), and that SGPs for students scoring at or near the HOSS will be high (preferably higher than 95 and not less than 80). Because few students may score exactly at the HOSS/LOSS, the top/bottom 50 students are selected and any student scoring within their range of scores are selected for inclusion in these tables. Consequently, there may be a range of scores at the HOSS/LOSS rather than a single score, and there may be more than 50 students included in the HOSS/LOSS row if the 50 students at the extremes only contain the single HOSS/LOSS score.

The “Student Growth Percentile Range” panel at bottom left shows the empirical distribution of SGPs given prior scale score deciles in the form of a 10 by 10 cell grid. Percentages of student growth percentiles between the 10^th, 20^th, 30^th, 40^th, 50^th, 60^th, 70^th, 80^th, and 90^th percentiles were calculated based upon the empirical decile of the cohort’s prior year scaled score distribution¹. Deviations from perfect fit are indicated by red and blue shading. The further above 10 the darker the red, and the further below 10 the darker the blue. A more detailed discussion about the reasons for and implications of model misfit can be found in the “Goodness of Fit” section of the 2016 Georgia Student Growth Model report.

The bottom right panel of each plot is a Q-Q plot which compares the observed distribution of SGPs with the theoretical (uniform) distribution. An ideal plot here will show black step function lines that do not deviate from the ideal, red line which traces the 45 degree angle of perfect fit.

Goodness of fit plots for SIMEX measurement error corrected models are also presented here for each analysis. The expectations in the SGP distribution panels are different for these models, where lower attaining students will receive higher SGPs and vice versa. This typically shifts the median lines in the mosaic plot panel and causes a red shift (more SGPs than expected) in the upper-right and lower-left quadrants of the “Student Growth Percentile Range” panel. See Appendix B of this report for a more detailed discussion of SIMEX models and description of their impact on SGP distributions.

2 End-of-Grade Analyses

2.1 ELA

Fig. A.1: Goodness of Fit Plot for Grade 4 ELA, 2016 (Uncorrected).

Fig. A.2: Goodness of Fit Plot for Grade 4 ELA, 2016 (SIMEX Corrected).

Fig. A.3: Goodness of Fit Plot for Spring 2016 Grade 5 ELA (Uncorrected).

Fig. A.4: Goodness of Fit Plot for Spring 2016 Grade 5 ELA (SIMEX Corrected).

Fig. A.5: Goodness of Fit Plot for Spring 2016 Grade 6 ELA (Uncorrected).

Fig. A.6: Goodness of Fit Plot for Spring 2016 Grade 6 ELA (SIMEX Corrected).

Fig. A.7: Goodness of Fit Plot for Spring 2016 Grade 7 ELA (Uncorrected).

Fig. A.8: Goodness of Fit Plot for Spring 2016 Grade 7 ELA (SIMEX Corrected).

Fig. A.9: Goodness of Fit Plot for Spring 2016 Grade 8 ELA (Uncorrected).

Fig. A.10: Goodness of Fit Plot for Spring 2016 Grade 8 ELA (SIMEX Corrected).

Fig. A.11: Goodness of Fit Plot for Spring 2016 Grade 9 ELA (Uncorrected).

Fig. A.12: Goodness of Fit Plot for Spring 2016 Grade 9 ELA (SIMEX Corrected).

Fig. A.13: Goodness of Fit Plot for Spring 2016 Grade 10 ELA (Uncorrected).

Fig. A.14: Goodness of Fit Plot for Spring 2016 Grade 10 ELA (SIMEX Corrected).

Fig. A.15: Goodness of Fit Plot for Spring 2016 Grade 11 ELA (Uncorrected).

Fig. A.16: Goodness of Fit Plot for Spring 2016 Grade 11 ELA (SIMEX Corrected).

2.2 Mathematics

Fig. A.17: Goodness of Fit Plot for Grade 4 Mathematics, 2016 (Uncorrected).

Fig. A.18: Goodness of Fit Plot for Grade 4 Mathematics, Spring 2016 (SIMEX Corrected).

Fig. A.19: Goodness of Fit Plot for Spring 2016 Grade 5 Mathematics (Uncorrected).

Fig. A.20: Goodness of Fit Plot for Spring 2016 Grade 5 Mathematics (SIMEX Corrected).

Fig. A.21: Goodness of Fit Plot for Spring 2016 Grade 6 Mathematics (Uncorrected).

Fig. A.22: Goodness of Fit Plot for Spring 2016 Grade 6 Mathematics (SIMEX Corrected).

Fig. A.23: Goodness of Fit Plot for Spring 2016 Grade 7 Mathematics (Uncorrected).

Fig. A.24: Goodness of Fit Plot for Spring 2016 Grade 7 Mathematics (SIMEX Corrected).

Fig. A.25: Goodness of Fit Plot for Spring 2016 Grade 8 Mathematics (Uncorrected).

Fig. A.26: Goodness of Fit Plot for Spring 2016 Grade 8 Mathematics (SIMEX Corrected).

3 End-of-Course Analyses (by Course Progression)

3.1 Algebra I

Fig. A.27: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: 2015 Grade 6 Math - Uncorrected).

Fig. A.28: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: 2015 Grade 6 Math - SIMEX Corrected).

Fig. A.29: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Math Grade 7 - Uncorrected).

Fig. A.30: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Math Grade 7 - SIMEX Corrected).

Fig. A.31: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Math Grade 8 - Uncorrected).

Fig. A.32: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Math Grade 8 - SIMEX Corrected).

Fig. A.33: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Geometry - Uncorrected).

Fig. A.34: Goodness of Fit Plot for Spring 2016 Algebra I (Prior: Spring 2015 Geometry - SIMEX Corrected).

3.2 Geometry

Fig. A.35: Goodness of Fit Plot for Spring 2016 Geometry (Prior: 2015 Grade 7 Math - Uncorrected).

Fig. A.36: Goodness of Fit Plot for Spring 2016 Geometry (Prior: 2015 Grade 7 Math - SIMEX Corrected).

Fig. A.37: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Math Grade 8 - Uncorrected).

Fig. A.38: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Math Grade 8 - SIMEX Corrected).

Fig. A.39: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Algebra I - Uncorrected).

Fig. A.40: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Algebra I - SIMEX Corrected).

Fig. A.41: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Algebra II - Uncorrected).

Fig. A.42: Goodness of Fit Plot for Spring 2016 Geometry (Prior: Spring 2015 Algebra II - SIMEX Corrected).

3.3 Algebra II

Fig. A.43: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: 2015 Grade 8 Math - Uncorrected).

Fig. A.44: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: 2015 Grade 8 Math - SIMEX Corrected).

Fig. A.45: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: Spring 2015 Algebra I - Uncorrected).

Fig. A.46: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: Spring 2015 Algebra I - SIMEX Corrected).

Fig. A.47: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: Spring 2015 Geometry - Uncorrected).

Fig. A.48: Goodness of Fit Plot for Spring 2016 Algebra II (Prior: Spring 2015 Geometry - SIMEX Corrected).